Print LmodError when loading GCCcore-12.2.0-based modules on `zen4` #841

casparvl · 2024-12-10T17:17:47Z

Depends on: Add known issue on foss-2022b not being supported for zen4 docs#357

Implements the idea from https://gitlab.com/eessi/support/-/issues/37#note_2159031831

But, not currently working, because the first module that gets installed that uses GCCcore-12.2.0 as dependency will try to load it (even with --module-only), which then fails:

== creating module...
  >> generating module file @ /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCCcore/12.2.0.lua
== ... (took < 1 sec)
== permissions [skipped]
== packaging [skipped]
  >> running command:
        [started at: 2024-12-10 18:12:47]
        [working dir: /gpfs/home4/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/modules]
        [output logged in /scratch-local/casparl.8987353/eb-bscq9hvh/easybuild-run_cmd-pxom1tke.log]
        bzip2 /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/software/GCCcore/12.2.0/easybuild/easybuild-GCCcore-12.2.0-20241210.181247.log
  >> command completed: exit 0, ran in < 1s
== COMPLETED: Installation ended successfully (took 1 secs)
== Results of the build can be found in the log file(s) /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/software/GCCcore/12.2.0/easybuild/easybuild-GCCcore-12.2.0-20241210.181247.log.bz2
== processing EasyBuild easyconfig /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/software/EasyBuild/4.9.4/easybuild/easyconfigs/p/pkgconf/pkgconf-1.9.3-GCCcore-12.2.0.eb
== building and installing pkgconf/1.9.3-GCCcore-12.2.0...
  >> installation prefix: /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/software/pkgconf/1.9.3-GCCcore-12.2.0
== fetching files [skipped]
== creating build dir, resetting environment...
  >> build dir: /tmp/casparl/easybuild/build/pkgconf/1.9.3/GCCcore-12.2.0
== Running post-ready hook...
== ... (took < 1 sec)
== unpacking [skipped]
== patching [skipped]
== preparing...
== Running pre-prepare hook...
== ... (took < 1 sec)
== FAILED: Installation ended unsuccessfully (build directory: /tmp/casparl/easybuild/build/pkgconf/1.9.3/GCCcore-12.2.0): build failed (first 300 chars): Module command '/usr/share/lmod/lmod/libexec/lmod python show GCCcore/12.2.0' failed with exit code 1; stderr: Lmod has detected
the following error: Unable to load module because of error when evaluating modulefile:
     /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/modules/al (took 0 secs)
== Results of the build can be found in the log file(s) /scratch-local/casparl.8987353/eb-bscq9hvh/easybuild-pkgconf-1.9.3-20241210.181248.DZrFb.log
0:00:02  1 out of 37 easyconfigs done: GCCcore/12.2.0 (OK)
ERROR: Build of /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/software/EasyBuild/4.9.4/easybuild/easyconfigs/p/pkgconf/pkgconf-1.9.3-GCCcore-12.2.0.eb failed (err: "build failed (first 300 chars): Module command '/usr/share/lmod/lmod/libexec/lmod python show GCCcore/12.2.0' failed with exit code 1; stderr: Lmod has detected the following error: Unable to load module because of error when evaluating modulefile:\n     /home/casparl/eessi/versions/2023.06/software/linux/x86_64/amd/zen4/modules/al")

maybe we can make that pre-prepare hook do nothing. Or skip the prepare phase. NOt sure...

…dError when they are loaded

eessi-bot · 2024-12-10T17:17:51Z

Instance eessi-bot-mc-aws is configured to build for:

architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

riscv-eessi-io-bot · 2024-12-10T17:17:51Z

Instance eessi-bot-riscv is configured to build for:

architectures: riscv64/generic
repositories: riscv.eessi.io-20240402

eessi-bot · 2024-12-10T17:17:52Z

Instance eessi-bot-mc-azure is configured to build for:

architectures: x86_64/amd/zen4
repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

eb_hooks.py

…e of the step-hooks, so we can unset it at the end

eb_hooks.py

casparvl · 2024-12-11T14:48:15Z

Ok, this PR is more or less ready, but we should create a known issues page on the zen4 tree missing 2022b / GCCcore 12.2.0. I think it can be very simple and state that because of issues observed with the OpenBLAS from that toolchain generation, we decided not to support it. It also makes sense: zen4 was only release end of 2022, so the 2022b stack would have had very little support for it.

casparvl · 2024-12-11T16:58:49Z

Ok, I'll need EESSI/docs#357 to be merged first. Then, I'll put a link to that part of the docs in the LmodError.

eb_hooks.py

casparvl · 2025-01-07T11:29:54Z

To test this PR:

$ export EESSI_SOFTWARE_SUBDIR_OVERRIDE=x86_64/amd/zen4
$ module load EESSI/2023.06
$ mkdir -p /tmp/my_install_prefix
$ export EESSI_USER_INSTALL=/tmp/my_install_prefix
$ module load EESSI-extend/2023.06-easybuild
$ # Proving this works when installing GCCcore 12.2.0 itself:
$ # Pass an existing source path with a proper config.guess - redownloading it seems broken today
$ eb GCCcore-12.2.0.eb --hooks software-layer/eb_hooks.py --sourcepath $HOME/.local/easybuild/sources
$ module av GCCcore/12.2.0
Lmod has detected the following error:  EasyConfigs using toolchains based on GCCcore-12.2.0 are not supported for the Zen4 architecture.
See https://www.eessi.io/docs/known_issues/eessi-2023.06/#gcc-1220-and-foss-2022b-based-modules-cannot-be-loaded-on-zen4-architecture
While processing the following module(s):
    Module fullname  Module Filename
    ---------------  ---------------
    GCCcore/12.2.0   /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCCcore/12.2.0.lua
$ # Trying something that only has GCCcore 12.2.0 as dependency:
$ eb libyaml-0.2.5-GCCcore-12.2.0.eb --hooks EESSI/software-layer/eb_hooks.py --sourcepath $HOME/.local/easybuild/sources
$ module load libyaml/0.2.5-GCCcore-12.2.0
Lmod has detected the following error:  EasyConfigs using toolchains based on GCCcore-12.2.0 are not supported for the Zen4 architecture.
See https://www.eessi.io/docs/known_issues/eessi-2023.06/#gcc-1220-and-foss-2022b-based-modules-cannot-be-loaded-on-zen4-architecture
While processing the following module(s):
    Module fullname               Module Filename
    ---------------               ---------------
    GCCcore/12.2.0                /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCCcore/12.2.0.lua
    libyaml/0.2.5-GCCcore-12.2.0  /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/libyaml/0.2.5-GCCcore-12.2.0.lua
$ # Trying something that has a lot of dependencies and thus uses --robot:
$ eb SciPy-bundle-2023.02-gfbf-2022b.eb --hooks EESSI/software-layer/eb_hooks.py --sourcepath $HOME/.local/easybuild/sources --robot
$ module load SciPy-bundle/2023.02-gfbf-2022b
Lmod has detected the following error:  EasyConfigs using toolchains based on GCCcore-12.2.0 are not supported for the Zen4 architecture.
See https://www.eessi.io/docs/known_issues/eessi-2023.06/#gcc-1220-and-foss-2022b-based-modules-cannot-be-loaded-on-zen4-architecture
While processing the following module(s):
    Module fullname                  Module Filename
    ---------------                  ---------------
    GCCcore/12.2.0                   /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCCcore/12.2.0.lua
    GCC/12.2.0                       /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCC/12.2.0.lua
    gfbf/2022b                       /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/gfbf/2022b.lua
    SciPy-bundle/2023.02-gfbf-2022b  /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/SciPy-bundle/2023.02-gfbf-2022b.lua
$ # Trying to load one of the dependencies installed for SciPy-bundle:
$ module load Python/3.10.8-GCCcore-12.2.0
Lmod has detected the following error:  EasyConfigs using toolchains based on GCCcore-12.2.0 are not supported for the Zen4 architecture.
See https://www.eessi.io/docs/known_issues/eessi-2023.06/#gcc-1220-and-foss-2022b-based-modules-cannot-be-loaded-on-zen4-architecture
While processing the following module(s):
    Module fullname               Module Filename
    ---------------               ---------------
    GCCcore/12.2.0                /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/GCCcore/12.2.0.lua
    Python/3.10.8-GCCcore-12.2.0  /tmp/caspar_eessi_test/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/Python/3.10.8-GCCcore-12.2.0.lua

I think all of these look as expected and intended. With that, I think this PR is ready for a final review (and hopefully merge :))

ocaisa

LGTM

eessi-bot · 2025-01-10T10:17:37Z

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.01.10

eessi-bot · 2025-01-10T10:17:38Z

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.01.10

bedroge · 2025-01-10T13:02:48Z

@casparvl @ocaisa shouldn't this be actually "built" and ingested?

ocaisa · 2025-01-10T13:04:32Z

bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1

eessi-bot · 2025-01-10T13:04:35Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1

eessi-bot · 2025-01-10T13:04:35Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from ocaisa
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- no jobs were submitted

eessi-bot · 2025-01-10T13:04:39Z

error: eb_hooks.py: patch does not apply

Unable to download or merge changes between the source branch and the destination branch.
Tip: This can usually be resolved by syncing your branch and resolving any merge conflicts.

boegel · 2025-01-10T13:13:24Z

We can take care of the ingest via #608 which is now ready to deploy & merge?

Initial attempt for an EasyBuild hook that makes modules print an Lmo…

d61f33d

…dError when they are loaded

ocaisa reviewed Dec 11, 2024

View reviewed changes

eb_hooks.py Outdated Show resolved Hide resolved

ocaisa reviewed Dec 11, 2024

View reviewed changes

eb_hooks.py Outdated Show resolved Hide resolved

This works, but we should probably set the environment variable in on…

9bb52dc

…e of the step-hooks, so we can unset it at the end

ocaisa reviewed Dec 11, 2024

View reviewed changes

eb_hooks.py Outdated Show resolved Hide resolved

Only set env var for prepare step

c26a1e5

ocaisa reviewed Dec 11, 2024

View reviewed changes

eb_hooks.py Show resolved Hide resolved

eb_hooks.py Show resolved Hide resolved

Caspar van Leeuwen added 3 commits December 11, 2024 14:28

Remove unused code

600adee

Use step hooks to set and unset force and module-only

b3fade9

Rename hooks to make more sense

6a1700e

casparvl marked this pull request as ready for review December 11, 2024 16:57

casparvl marked this pull request as draft December 11, 2024 16:58

ocaisa requested changes Dec 12, 2024

View reviewed changes

eb_hooks.py Outdated Show resolved Hide resolved

eb_hooks.py Outdated Show resolved Hide resolved

eb_hooks.py Outdated Show resolved Hide resolved

eb_hooks.py Outdated Show resolved Hide resolved

ocaisa reviewed Dec 12, 2024

View reviewed changes

eb_hooks.py Show resolved Hide resolved

eb_hooks.py Show resolved Hide resolved

Processed Alan's comments

78542d1

casparvl marked this pull request as ready for review January 7, 2025 09:33

ocaisa reviewed Jan 7, 2025

View reviewed changes

eb_hooks.py Outdated Show resolved Hide resolved

Fix formatting

54abb68

ocaisa approved these changes Jan 10, 2025

View reviewed changes

ocaisa merged commit a2c8ffb into EESSI:2023.06-software.eessi.io Jan 10, 2025
50 checks passed

ocaisa mentioned this pull request Jan 10, 2025

add support in archdetect for detecting A64FX #608

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Print LmodError when loading GCCcore-12.2.0-based modules on `zen4` #841

Print LmodError when loading GCCcore-12.2.0-based modules on `zen4` #841

casparvl commented Dec 10, 2024 •

edited by ocaisa

Loading

eessi-bot bot commented Dec 10, 2024

riscv-eessi-io-bot bot commented Dec 10, 2024

eessi-bot bot commented Dec 10, 2024

casparvl commented Dec 11, 2024 •

edited

Loading

casparvl commented Dec 11, 2024

casparvl commented Jan 7, 2025

ocaisa left a comment

eessi-bot bot commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025

bedroge commented Jan 10, 2025

ocaisa commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025 •

edited

Loading

eessi-bot bot commented Jan 10, 2025

boegel commented Jan 10, 2025

Print LmodError when loading GCCcore-12.2.0-based modules on zen4 #841

Print LmodError when loading GCCcore-12.2.0-based modules on zen4 #841

Conversation

casparvl commented Dec 10, 2024 • edited by ocaisa Loading

eessi-bot bot commented Dec 10, 2024

riscv-eessi-io-bot bot commented Dec 10, 2024

eessi-bot bot commented Dec 10, 2024

casparvl commented Dec 11, 2024 • edited Loading

casparvl commented Dec 11, 2024

casparvl commented Jan 7, 2025

ocaisa left a comment

Choose a reason for hiding this comment

eessi-bot bot commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025

bedroge commented Jan 10, 2025

ocaisa commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025

eessi-bot bot commented Jan 10, 2025 • edited Loading

eessi-bot bot commented Jan 10, 2025

boegel commented Jan 10, 2025

Print LmodError when loading GCCcore-12.2.0-based modules on `zen4` #841

Print LmodError when loading GCCcore-12.2.0-based modules on `zen4` #841

casparvl commented Dec 10, 2024 •

edited by ocaisa

Loading

casparvl commented Dec 11, 2024 •

edited

Loading

eessi-bot bot commented Jan 10, 2025 •

edited

Loading